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APPELLANT'S REQUEST FOR 
REINSTATEMENT OF APPEAL AND 
SUPPLEMENTAL BRfFl? nvTp^ 



I hereby certify that this eoncspoiidfitncc is being 
deposited with the United States Postid Service 
as first class mail in an envelope addressed to: 
Commissioner fin- Patents, PO Box 1450, 
Alexandria. VA22313 




Mail Stop Appeal Brief - Patents 
Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 22313-1450 

Sir: 

This Brief is presented in support of a Request for Reinstatement of the AppeaJ filed 
herewith, from the rejection of Claims 1-27 of the above-identified application, as set forth in the 
Office Action mailed August 12, 2004. 

There is no fee for the Request for Reinstatement Please deduct any additional fees or 
credit any excess fees associated with the Appeal Brief to Deposit Account 501861. Appendix 
A, attached hereto, contains a copy of all claims pending in this case. 
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REAL PARTV QF INTFPPRT 

The Real Party of Interest is Shutterfly Inc., a Delaware corporation. 



I* 

is 
i * 

* RELATRD apprat s A\rr) INTEPFFftFisir'pg 



There are no related appeals or interferences for the above-referenced 



patent application. 



STATUS OFrT.ATM ft 

Claims 1-27 are pending and are the subject of this Appeal. Ml claims have been 
rejected. Claims 1-27 are the subject of this appeal. No oflier claims are pending. 



STATUS OF AMENDMENTS 

The claims were amended in response to an Office Action mailed in February 2003. A 
Final Office Action was mailed on April 26, 2004. An Appeal Brief was filed May 27, 2004, 
and an Office Action mailed August 12, 2004 raised new grounds of rejection. 

A copy of all the pending claims, prior to the after final amendment, is provided in 
Appendix A attached hereto. 

SUMMARY OF THE INVENrTTQM 

In one aspect the invention provides a method of generating a frame prototype image 
showing a picture image framed within a frame. The method includes providing a frame image 
showing die frame in a perspective view, the frame image having a picture portion corresponding 
to the portion of the frame used to view a picture mounted in the frame; mapping the picture 
image to the picture portion of the frame image in order to generate the frame prototype image 
wherein the perspective frame image is not shown in a head-on view; and providing an enhanced 
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edit set along with the frame image, the enhance ■ i 

rite the p teure or .HLt IT Ceded " 3B,UKlUd ' nS — «*— H. »* fo, 

fi^luic or me rrame m the perspective view 

dec .J^.^ 0 ^^ Thesystemsandmethod* 

car*, t-shm, mu gs , other nov , Ity items _ ^ ^ ^ play ^ ^ 

^^^^^ 

^«ofd. n n^« 1 ^ fa ^^ Theusercanapplyon™ 

the lm age, producing a resultant image that can be provided in a perspective view in the 
env.ronment. The framed image can be manipulated to change its position, orientation, or size . 
ISSUES PR INTED FOR RFVIPy / 



I. 

n. 
in. 

IV. 



WHETHER CLAIMS 1-9, 11, 18 AND 26 ARE ANTICIPATED BY OLES 
(6,047,130) AND TEO (6,064,399) 

WHETHER CLAIM 10 IS PATENTABLE UNDER SECTION 103(A) OVER 
OLES, TEO AND KURASHIGE (5,282,262) 

WHETHER CLAIMS 12-17, 19-22 AND 24-25 ARE PATENTABLE UNDER 
SECTION 103(A) OVER OLES, TEO AND OBERG (5,870 771) 
WHETHER CLAIM 23 IS PATENTABLE OVER OLES, TEO. OBERG AND 
FREEMAN (6356,288). 

WHETHER CLAIM 27 IS PATENTABLE OVER OLES, TEO AND MORRIS 
(6,453,361). 



GROUPING OF f.T.ATv/rg 



For each ground of rejection that appellant contest herein, which applies to more than one 
claim, such additional claims, to the extent separately identified and argued below, do not stand 
or fall together. 
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ARGUMENT 

CLAIMS 1-9, It, 18 AND 26 ARE NOT ANTICIPATED BY OLES AND TEO 

vTsli ?r monitors ^ professM Ph <~ — - 

matchmg picture W within a simulated roottl ima,, Te. di»l oses a ^ ^ 
constructing a panose i.age mcIuding ^ sfeps of applying p^c curvature to at l eas t 
oncixnage, thereby to create a panose ground embedding in the panoramic back^und 
an adcLtional image having a geometry other than that of the panoramic curvature thereby to 
pnmde a composite panoramic image containing an embedded image corresponding to the 
addxtional image and whose geometry matches that of the panoramic background. 

Generally, the present rejection docs not establish prima facie anticipation. A single 
oted art reference must teach each and every . lament of the claim to establish anticipation under 
35 U.S.C §102, M.P.E.P. §2131; /* re Royka, 180 U.S.P.Q. 580 (CCPA 1974) ("All words in a 
claim must be considered in judging the patentability of that claim against the prior art") The 
Court of Appeals for the Federal Circuit has held that, "the identical invention must be shown in 
ascompietedetaila S i S containedmme....claim.» Richardson v. Suzuki Motor Co 9 
U.S.P.Q.2d 1913, 1920 (Fed. Cir. 1989). In the instant case, the Jordan et al. patent fails to 
describe or suggest several specific limitations recited in the claims of the present invention. 

Per MPEP Section 706.02, for anticipation under 35 U.S.C. 102, the reference must teach 
every aspect of the claimed invention either exnlldHv In Oles, all appearances 

used "size perspective" for video image. Column 2 line 1 of Oles states "The present invention 
overcomes these deficiencies by providing a method and apparatus that allows a customer to 
usually determine the appropriate size of a portrait photograph and matching picture frame by 
displaying upon a portrait display viewer a perspective view of a combined video image of the 
Photograph and the matching frame within a emulated room image." Further, Column 5 line 31- 
-35: "The present invention as depicted in FIG. 5 allows the customer or operator to change the 
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perspective of the video image (and the size of the mm. ^ , 

■ 01 me resultm g portrait) as well as move and 

position the combined image within the sim.il^ - 

* vvnjuji me simulated room setting imaee ,f Th.' c ;* 

In sum, .he "per^tive" t«m in 01« relate, to u, e w of ^ „„..,,, „ 

recite wherem the fW fa^ j, ^ ^ ,„ ,„ ,„ , ^.^^ 

present invention, a discussion of the "perspective view" is provided on page 6 as fcn^ 

For example, a irame can be inm^^ X ^i^S^ "k !!^ n 
(e.g.. on a table) and then a digital camera can Z ^ld t^Zu^ ^ *" displ3ved 

frame as it appears in the scene Also awhS nt™ nf 1 P ^ a f erepectlve ,ma 2 e * «» 
mounts b£ fiume *J^t^££%^J£^ f er SU, ? bl * « be 

frame Image will include a white region iSLS^S^SlSS" ! ^ f* 
frame (also referred to here as the "%^^<)^ZS* f™™*^ * visible in the 
image 300 having a picture area SoI'sToSfig 3A * ^ * ^ 

As shown above, Oles cannot anticipate the invention as it only shows a head-on view 
The Exarniner notes thai Teo taught the missing element. However, Teo fails to show each of 
the churned element and cannot anticipate the claims. Withdrawal of the anticipation rejection is 

requested. 

Moreover, Applicants traverse the unpatentable rejection over Oles and Teo. Teo shows 
amethod and system for embedding images and video segments within a panoramic image of a 
scene, so as to maintain the proper perspective. However, Teo deals with panoramic images of 
scenes used to provide a viewer with an immersive surround experience, as if the viewer was 
standing in the center of a soene gazing in several directions. Panoramic images can be produced 
by tabng multiple snapshots of a scene, as a camera is rotated horizontally and possibly also 
vertically. The snapshots are joined together and projected onto an appropriate geometrical 
surface, such as a cylinder or sphere, to reproduce an omniview effect. Applying Teo to Oles 
would not result in an operable system as the projection of the picture image in Oles onto a 
cylinder or sphere would severely distort the image. Hence, the combination of Oles and Teo 
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would not be operable. Further, there is no motivation to combine the omr.ivi • 

Teo to Oles. e toe om ™ viewing system of 

Additionally, Oles and Teo fail to show at feast the clam,*! 
-etl^^ 

. sTiSh^ 

transposed as a 5"x7" L^^deoTr^f^ 

manipulate or post-process the video Wei™™^ T ^ °P erator tang able to 
enlarging the image, rotating 4^?^ rL,^ °£!? yB reducin 8 or 

viewer 20. T*e p^t ^^ 52^2 -^portrait 
available for viewing so that the operator c^o ZuthThe^f framcs 
one suitable for the portrait. EssentSly, tS^SSS^ST ^ to 
frame catalog within its storaee svstem ^th Tf« J? ?-?■ ,ncoi P on *es a picture 
video imaged with the 52^2^^ ? 
depicted in FIG. 3. The present invention ^lows^togSpneTto Z^Tf^ " 
every existing style and color of picture frame aviSSI^SS ? • customer 
select from the many styles and to^SSSX^^ 18 abk 10 

display the portrait. M I of thtprS mveSs^t Jl ^ « m P Iement 
for use on the combined picture^ r4Sge Z ***** * ***** 

Oles describes item 22 as "Option menu 22 provides user access to all of the functions of 
the present invention such as reducing or enlarging the selected video image." However 
nowhere in Oles does it show specifically the "providing an enhanced edit set including user 
manipinable tools for editing either the picture or the ^ m me per.pective view (wherein th. 
frame unape is not shown in a head-on view ) as discussed above. Here, Oles shows a 2D 
rendering of the picture or the frame from a frontal view. It does not show user manipulate 
tools tor editing either the picture or the frame in the perspective view. 

^ Applicants respectfully traverse me Section 102 rejection. Per MPEP Section 706 02 for 
anncipation under 35 U.S.C. 1 02, the reference must teach every ^ »f ^ ' 

invention either .vp.ioi^orfmpKorlly . Here, Oles shows neither the perspective view nor the 
tools to edit the picture or the frame in the perspective view. 
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Section 102 rejection on claims 1-9 11 iR a „Ho/:- * 

slid 26 is respectfully requested. 

TEO AND OBERG, CLAIM 23 K PA^T A R f C ^ ATENTABLE OVER <>LES, 
F-EMAHANDCLA^^™ 

Claim 10 was rejected under Section 103(a) over Oles and Kurashige (5,282 262) 

(6,356,288). Clan* 27 was rejected as unpatentable over Oles and Morris (6.453 361) 

First, Appellant notes that references can not be arbitrarily combined. There must be 

some reason why one skilled in the art would be motivated to mat* *. a ^ . 

u uc monvaiea to make the proposed combination of 
references. In reNomiya, 184 U.S.P.Q. 607 (CCPA 1975). 

Additionally, these claims are aUowable as they depend from allowable cJaim 1. Further 
noneofthercferencesshow^^ ' 

neither Oles, Tec nor Kurashige show displaying of the image and frame in the perspective view 
and the user tools fof 

Kurashtge relates to a hardware apparatus for Worming a two-dinaensional input video signai 
onto a three-dimensional surface and for depicting Ulumination thereof by a spot light source 
transforms the two-dimensional video signal in accordance with a mapping data signal onto the 
Wdirnensional surface. However, there is no specifics of displaying of the image and frame 
in the perspective view and the user manipulate tools for editing either the picture or the fW 
m the perspective view, and there is no suggestion of combining Kurashige with Oles. 
Withdrawal of the rejection of claim 10 is requested. 

To further illustrate, as to claims 12-17 IQ-"?? an w « rt t j 

, iw ™ v-22. and 24-25, Oberg does not show providing 

a frame unage showing the frame in a perspective view, the frame image having a picture portion 
corresponding to the portion of the We used to view a picture mounted in the frame. The 
frame molding 62 shown in FIG. 3 is shown as a top view, indicating that it is NOT a perspective 
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provide a combined view. p ea 10 

M«»vcr. Oberg fails to fc, the . 

te. . i the perspective view. Oberg is completely silent <m where to ethting se, is plMed 
^vetotoWnnag, Obex's Fig. 3 shows only the frame and nothing else. Win*™™, 
of the rejection of claims 12-17, 19-22 and 24-25 is requested. 

««1 ^ ^^^^ >»3W-unp aten tab.eove r 01es,Te„a lrf Mo niS 
(MMJ61). Mo TO relates to an online system wfth a server for communicating with boti, client 
devices and photo-sharing web sites over a network. 

^lfc^«^«^trWfcrej^rfcWm27. Here, rafter Oles nor Morris 
shows instructions to provide a frame image ^teMgJ^ fa . „„„ „ 

■mage having a picture portion corresponding to the r«>rti™ of ttc frame used to view a picrore 

mountedinthefl^e^thepignre^Mo^p^^^^,. , ^ ^ | |u 

generate the Same prototype image; and provide a- ^ sa „„„„ ^ ^ 

■M me enhanced edit set including user manipulative tools fb, editing efther the picture or 
«hc frame m the pmpective view Hence, claim 27 is ptuenttble over 0 ies and Morris for each 
of these reasons. 

Secondly, Applicants note that no motivation or suggestion, either in the cited art 
reference or in the knowledge generally available to one of ordinary skill in the art, has been 
oted by the Examiner to modify the Oles reference with Oberg so as to produce the claimed 
mvenhon. Further, Applicants fail to identify any motivation to modify the reference teaching so 
asprov.de uploading of images that were edited and/or previewed in the perspective view 
arrangements as presently claimed. Applicants point out that the Examiner hears the initial 
burden of factually establishing and supporting any prima facie conclusion of obviousness In re 
RineHar, 189 U.S.P.Q. 143 (CCPA 1976); M.P.E.P. § 2142. If the Examiner does not produce a 
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case. ^ Apprioa,,, is ^ ^ obligMion m ^ 
those dtillM ■ « —nvwencu m Moms, or how knowledge of 

2001) ([I] n a determination of patentability th.nr.^. • , vw-ur. 

:r° fl r 8S r ,heBoaidmus,poin,,osome — ^ 

^ K ^.°**"MonWerence.or^^ 

frame .mage showing ^ „ , ^ p ^^^^ 

^.magewthe^po^ofth^ ^^^^^^^ 
unage; and ^a, an en Han ^i edi, set aionp wj ,„ tnf (jgn,^ te enhanced edit se, 
mcluding user^anipultuable tools for editing eitoer the picture or W injhe^etiv, 
W2L and to upload the reslllting image „, , ^.^^ ^ of ^ ^ ^ ^ 

been estabhshed. As such, it is respectfully requested that the § 103(a) rejection of claim 27 and 
all claims be withdrawn. 



CONCLUSION 

Appellant believes tbat the above discussion is fully responsive to all grounds of 
reactions set forth in the Final Office Action. 

Please charge any required small entity fees to Deposit Account 501861. 



Respectfully submitted, 
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APPENDIX A 
COMPLETE SET OF PENDING CLAIMS 

a 'frirr °?r atin8 a *- ^ ^^^^^ 

a frame, the method comprising: 

ha™, 8 a p.aurc porta concpoodi^ , 0 4. portion of the flame to ^ , ^ 

mounted in the frame; 

mapping the picture image to the picture portion of the frame ima g e in order to 
generate the frame prototype image wherein the perspective frame image is not shown in a 
head-on view; and 

providing an enhanced edit set along with the frame image, the enhanced edit set 
including user manipulate tools for editing either the picture or the frame in the 
perspective view. 
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2. The method of claim 1, further comprising identifying a picture portion of the frame 

image, 

3. The method of claim 2, wherein identifying me picture portion of foe frame image 
includes providing a mat identifying the picture portion of the frame Image. 

20 4. The method of claim 3, wherein the mat includes a plurality of pixels, each pixel 
having a pixel value. 

5. The method of claim 4, wherein identifying the picture portion of the frame image 
includes setting each pixel in the mat that correspond* to the picture portion of the frame 

25 image to a first pixel value, 

6. The method of claim 2, wherein identifying the picture portion of the frame image 
includes idtaitifying the outer perimeter of the picture portion of the frame image. 
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7. The method of claim 1, wherein the picture portion of the frame image has a 
quadrilateral shape and the method further includes identifying the picture portion of the 
frame image including identifying the four corners of the picture portion, 

5 8. The method of claim 1, further comprising displaying the frame prototype image. 

9. The method of claim 1, wherein mapping the picture image to the picture portion of 
the frame image includes texture mapping the picture image to the picture portion of the 
frame image. 



10 



10. The method of claim 1, wherein the mapping the picture image to the picture portion 
of the frame image includes mapping the picture image to the picture portion of the frame 
image using the illumination of the picture portion of the frame image. 



15 U. The method of claim 1 , wherein the frame image is captured using a digital 



camera. 



12. The method of claim 1 wherein the enhanced image set includes a cropping tooiand 
the method includes 

cropping the picture in accordance with user instructions; and 
20 presenting the cropped picture in the picture portion of the frame image. 

13. The method of claim 1 , wherein the enhanced image set includes a border tool and the 
method includes 

adjusting the border of the picture in accordance with user instructions; and 
25 presenting the picture including new border in the picture portion of the frame image. 

14. The method of claim 1, wherein the enhanced image set includes an effects tool and 
the method includes 

applying an effect to the picture in accordance with user instructions; and 
30 presenting the picture including selected effect in the picture portion of the frame image. 
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15. The method of claim 14, further comprising selecting the effect from the group 
consisting of black & white, soft focus, color tone and saturate. 

16. The method of claim 14, wherein the effect applied is color tone and the method 
S further comprises 

receiving color tone adjustment data and presenting a color tone adjusted picture in the 
picture portion of the frame. 

1 7. The method of claim 1 , wherein the enhanced image set includes a rotation tool and 
1 0 the method includes 

rotating the frame in accordance with user instructions; and 
presenting the rotated framed in the framed image. 

1 8. The method of claim 1 9 wherein the enhanced image set includes a rotation tool and 
the method includes 

1 5 rotating the picture image in the frame in accordance with user instructions; and 
presenting the rotated picture image in the frame of the framed image. 

19. The method of claim 1 , wherein the enhanced image set includes a border tool and the 
method includes 

20 receiving a border width selection; 

adjusting the border width of the picture image in accordance with the border width 
selection; and 

presenting the picture image including adjusted border in the framed image. 

25 20. The method of claim 1 , wherein the enhanced image set includes a frame adjustment 
button and the method includes 
receiving a frame size selection; 

changing a size of the frame in the perspective view in accordance with the frame size 
selection; 

30 mapping the picture image to a picture portion of the new size frame; and 
presenting the picture image in the framed image. 

12 
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2 1 . The method of claim 1 g wherein the enhanced image set includes a trimming tool and 
the method includes 

trimming the picture image in accordance with user instructions; and 
presenting the trimmed picture image in the frame of the framed image. 

5 

22. The method of claim 1, wherein the enhanced image set includes a delight me tool 
and the method includes 

activating the delight me tool upon user request; 
automatically selecting a feature or effect to apply to the framed image; 
10 applying the selected feature to the framed image; and 
presenting the framed image. 

23. The method of claim 22, wherein the step of automatically selecting a feature 
includes randomly selecting a feature. 

15 

24. The method of claim 22, wherein the step of automatically selecting a feature or 
effect includes selecting a feature or effect to apply to the picture image. 

25. The method of claim 22, wherein the step of automatically selecting a feature or 
20 effect includes selecting a feature or effect to apply to the frame. 

26. A computer program product tangibly embodied in a computer-readable medium, for 
generating a frame prototype image showing a picture image framed within a frame, 
comprising instructions operable to cause a computer to: 

25 receive the picture image; 

store a frame image showing the frame in a perspective view and a mat identifying the 
picture portion of the frame image; 

map the picture image to the picture portion of the frame image in order to generate the 
frame prototype image wherein the frame image is not shown in a head-on view; and 
30 provide an enhanced edit set along with the frame prototype image, the enhanced edit set 
including user manipulatable tools for editing either the picture or the frame in the 
perspective view. 
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*ithm a the system *»» ^ • Wd 

^^-co^icationwithaco.putc.nctworf, j^' . 
computer-readable tedium, the server ™*„ 8 SOftware bodied in a 

serveno: ^ "° W operable lo cause ^ 

receive the picture image from ^ dIent oonpg)ar 
PmpMh* ed,tm8e " ta! ' te P«=>ureo,ftc aaiIMtotlle 



1 5 perspective view; and 
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